arXiv:1508.01352vl [physics.soc-ph] 6 Aug 2015 


Resilience of Networks Formed of Interdependent Modular Networks 


Louis M. Shekhtman, 1 Saray Shai, 2 and Shlomo Havlin 1 

'Department of Physics, Bar-Ilan University, Ramat Gan, Israel 
2 Department of Mathematics, University of North Carolina, Chapel Hill, North Carolina, USA 

(Dated: August 7, 2015) 

Many infrastructure networks have a modular structure and are also interdependent with other infrastructures. 
While significant research has explored the resilience of interdependent networks, there has been no analysis 
of the effects of modularity. Here we develop a theoretical framework for attacks on interdependent modular 
networks and support our results through simulations. We focus, for simplicity, on the case where each 
network has the same number of communities and the dependency links are restricted to be between pairs 
of communities of different networks. This is particularly realistic for modeling infrastructure across cities. 
Each city has its own infrastructures and different infrastructures are dependent only within the city. However, 
each infrastructure is connected within and between cities. For example, a power grid will connect many 
cities as will a communication network, yet a power station and communication tower that are interdependent 
will likely be in the same city. It has previously been shown that single networks are very susceptible to the 
failure of the interconnected nodes (between communities) Q) and that attacks on these nodes are even more 
crippling than attacks based on betweenness Q. In our example of cities these nodes have long range links 
which are more likely to fail. For both treelike and looplike interdependent modular networks we find distinct 
regimes depending on the number of modules, m. (i) In the case where there are fewer modules with strong 
intraconnections, the system first separates into modules in an abrupt first-order transition and then each module 
undergoes a second percolation transition, (ii) When there are more modules with many interconnections 
between them, the system undergoes a single transition. Overall, we find that modular structure can significantly 
influence the type of transitions observed in interdependent networks and should be considered in attempts to 
make interdependent networks more resilient. 
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I. INTRODUCTION 

Many recent studies have explored interdependent and 
multilayer networks lf3 U33l . Further studies have also 
explored more realistic structures such as spatially em¬ 
bedded networks | [34U39l . and different types of realis¬ 
tic failures such as response under degree-based attacks 
|4(T4[| and localized attacks |26)’38). Nevertheless, all 
previous studies on interdependent networks ignored the 
realistic effect of modularity on the resilience of interde¬ 
pendent networks. 

Many real world networks have a modular structure in¬ 
cluding biological networks (42), infrastructure such as 
the power grid, internet (43) and airport networks (44), 
and financial networks (45). Several studies have ex¬ 
plored the robustness of individual modular systems (i.e. 
single networks) [46]07) yet no study has considered the 
effect of interdependence in modular networks. It is well 
known that many of these systems are also interdepen¬ 
dent and thus it is crucial to understand how the modu¬ 
lar structure affects the resilience of interdependent net¬ 
works. 

There has also been considerable work on understand¬ 
ing various types of attacks on networks M IM108}- 
[50| . Recent work by Shai et al. (T) developed an ana¬ 
lytical method where the attack is carried out on inter¬ 


connected nodes, i.e. nodes that connect communities. 
Further work by da Cunha et al. (2) showed that in real 
networks, attacks on interconnected nodes are even more 
damaging than attacks based on betweenness. It is par¬ 
ticularly important to consider the effectiveness of this 
type of attack in interdependent networks since the re¬ 
searchers in |2) showed that the US power grid is among 
the most susceptible networks to this type of attack and 
it is well known that power grids are interdependent with 
other infrastructures. 

In our model we assume modular networks composed 
of m modules, and a fixed ratio, a, between the proba¬ 
bility for an intramodule link and intermodule link. We 
further fix the total average degree, k tot , of the network. 
Using these three parameters we can determine the aver¬ 
age intramodule degree, k ultrd and the average intermod¬ 
ule degree k mlcr . We obtain 

^intra __ & ^ ^ ^ 

Winter til — 1 

^tot = Lnlra + Winter- (2) 

Note that £j ntel - increases with m, since networks with 
more modules have more interlinks m. We generate n of 
these modular networks, and for simplicity we assume 
that each network has the same m, a and k. We then 



create dependency links between the nodes in the differ¬ 
ent networks. The fraction of nodes in network i which 
depend on nodes in network j is defined as q;j. The de¬ 
pendency links are either bidirectional (in our analysis 
of treelike dependencies. Sec. Ill, Fig. |Ta|l or unidirec¬ 
tional (in our analysis of looplike dependencies. Sec. IV, 
Fig. [Tb| . In both cases we further restrict the dependency 
links such that a node in community m a in network i will 
depend on a node in community m a in network j, i.e. the 
dependency links are within the same community. This 
restriction is particularly reasonable in our example of 
cities where each city has its own tightly connected, in¬ 
terdependent infrastmcture with relatively few connec¬ 
tivity links between the cities. 

We focus on the case of attack on the interconnected 
nodes, i.e. nodes with at least one connectivity link to 
a different module. Many studies have shown that these 
links are particularly susceptible to failure in biological 
networks and serve as efficient targets in attacking infras¬ 
tructure 12. Further in our example of cities, these nodes 
have the longer distance links that are more likely to fail 

EH- 

Our attack randomly removes a fraction 1 - r, of the 
interconnected nodes in the network until there are no re¬ 
maining interconnected nodes and then continues to re¬ 
move nodes randomly. The fraction of unremoved inter¬ 
connected nodes, r, is related to the overall fraction of 
unremoved nodes, p , by 


1 Pinter 

where is the probability that a node is not intercon¬ 
nected. 

We study this model on both treelike networks of net¬ 
works (NoNs) and looplike NoNs (Fig. [TJ and find that 
there are two distinct regimes depending on the num¬ 
ber of modules, m. In the first regime, for small m, the 
network first separates into isolated, interdependent, yet 
functional modules, i.e. there is a transition at r = 0. 
However, for larger m the network collapses due to the 
removal of a finite nonzero fraction of interconnected 
nodes. We provide an analytic solution that predicts the 
critical point, m*, where the system has a transition from 
one behavior to the other, as well as solutions for the size 
of the giant component as a function of the fraction of 
removed nodes. We support our theory by simulations. 


II. FA IT .I IRE AND ATTACK ON INTERDEPENDENT 
MODULAR NETWORKS 

We now extend the method of Callaway et al. ||49| to 
the case of interdependent networks or network of net¬ 


works (NoN). We will then specifically apply this frame¬ 
work to the case of interdependent modular networks. 

We begin by recalling the derivation in li49l for a single 
network i with a given degree distribution P,(k) described 
by the generating function 

oo 

G(x) = £ P,(k)x k . (4) 

k=0 

For degree based attacks where nodes with degree k are 
removed with probability 1 - r/ ( , the generating function 
is 1491 

oo 

Fo(x) = ^ r k Pj(lc)x k . (5) 

k= 0 

The generating function of the branching process is then 

Fi(x) = F' 0 (x)/G'(x). (6) 

Following Callaway et al. |49l we obtain the probability 
that a randomly chosen edge leads to a cluster of given 
size, H i(x), as 

H\(x) = 1 - Fi(x) + xF\ [Hi(x)] (7) 

and the probability that a randomly chosen node leads to 
a cluster of a given size, Hq(x), 

H 0 (x) = 1 - F 0 (Y)+ xF 0 [H [ (x)]. (8) 

The fraction of nodes in the giant component is 

Poo(x) = 1 - H 0 (l) = F 0 ( 1) - F 0 (u), (9) 

with u being the smallest non-negative real solution of 
the self consistency equation 

u = 1 — Fi(l) + F\(u). (10) 

In order to generalize this framework for the case of 
attack on a NoN we must include the fact that nodes have 
an additional uniform likelihood to fail, 1 - /; ( | cp , where 
/?dep comes from the effect of the dependency links and 
depends on the specific topology of the NoN. 

In such a case we have that 

Fo(x ) = Pdep ^ r k Pi(k)x k (11) 

k=0 

where Fq(x) is the anologue of Eq. ([sji for interdependent 
networks and p ^ ep can be extracted from the sum since it 
does not depend on the degree of the node. The rest of 
the derivation continues the same for Eqs. 

We note that Eq. ([T()| is the same as before only now 
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FIG. 1: (Color online) We study two possible configurations of a network of networks, (a) A treelike network of networks with 
full coupling and bidirectional dependency links and (b) a looplike network of networks with a fraction of dependent nodes, q, and 
unidirectional dependency links. In both (a) and (b) dependency links are restricted such that they only connect nodes within the 
same communities, i.e a node in module m a in network i will depend on a node also in module m a in network j. (c) Demonstration 
of the dependency between a pair of interdependent networks shown in (a) and ((b). The dependency is between the same 

communities in different networks (same colors). 


with the extra factor of pd ep , giving 


1 — /?dep 

U ~ 1 


( 12 ) 


and Eq. (|9j> also will have the same factor /? ( | C p. This 
pair of equations, Eqs. ([9]) and l [T2| ), can be used to find 
the giant component of a NoN under any sort of degree 
based attack and can be used as an alternative method to 
that of Huang et al. PFll and Dong et al. |40| . 

We will now generalize this framework to the case 
where each network in the NoN is a modular network 
with the parameters m , a, and k, defined above. For the 
case of a modular network where the modules are made 
up of Erdos-Renyi stmctures, Eq. <0 becomes 

/-) _ inter 

(13) 

— g 'nnter 


We recall the results from Shai et al. CD for the generat¬ 
ing functions 


G(x) = 

F 0 (x) = i _ r) + rG{x) 

F\(x) = F' 0 (x)/G'(x). 


(14) 

(15) 

(16) 


We now combine the results from Shai et al. 0 for a 
single network with Eqs. tf and ( p~2] > for a NoN. We 
note that these equations not only describe the case of an 
interdependent modular NoN but also the case where we 
have both random failure with probability 1 - p m n& and 
targeted attack. For our purposes we will assume that 
Prand = Rdep, i.e. the random damage is solely the result 
of the dependencies. Our new generating functions are 
thus. 


Fo(x) = PdepfoM 

F\{x) = Pdepfi(x). (17) 

The average connected component size is given by Le- 
icht and D’Souza ||6l . 


(s) — RdepT'o(l) T /flcpr/\'intraf'(>( i ),/0 + /?dep Winter./1 (18) 

where 

jo ~~ Pdepk\)( 1 ) + Pdcp^f intra f ()( 1 )./0 + /Aleprfinier,/ 1 (19) 

J I — Pdep^ + /.’deprA'mtra./O + Rdepr^interjl • (20) 

Combining the above equations, we find that there is a 
giant component that spans the system when 


(1 Prand^intra(^ " k ' + Y c f c C inter ))(l Prand r c Winter) /VaiidC^intra^iiuer — 0 

r c (Prand^intra^intei-e ) + r c(Przn&k \inter + Prand^intra — Prand^intra^ mlLr — P^ an( \k[ n ^ a k m i er 6 mter ) + (/Aand^intra^ m ' u ~ 1) — 0 

( 21 ) 
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which can be solved using the quadratic formula for r c . 


connected component. The fraction of nodes which fail 
due to the effect of the dependencies is given by 


III. TREELIKE NETWORK OF INTERDEPENDENT 
MODULAR NETWORKS 


We now consider the case of a treelike NoN (see Fig. 


la l with full dependency and no-feedback, i.e. if network 


i depends on network j then each node in i depends on a 
single node in j and vice versa. As stated earlier, this can 
serve as a good model of infrastructure across cities. We 
remove a fraction 1 - r of the interconnected nodes from 
one of the networks and aim to obtain the mutual giant 


J 


p dev = (1 - e ’. (22) 


This can be understood by noting that each node is a part 
of a n-tuple of interdependent nodes and we require that 
all these n nodes be in their networks respective giant 
components. Therefore, besides the node itself, there are 
n— 1 dependent nodes that must all be in their networks’ 
respective giant components after the initial attack. 


If we combine Eqs. 0 ( [T2| , and ( |22| we obtain the 
mutual giant connected component in the NoN, 


P = 

1 CO — 


_ j(e- k '^(] - r){] - i 

£(1 _ g-mkiaaP^yi 


°) + r(l - e 


(fcintra + t'imer ) l 1 c 


>)<1 


(fcintra "Winter) P." XH 1 


0 < r < 1 
r < 0. 


(23) 


Since the dependency links are within modules, Eq. 
for r < 0 is simply the equation for a treelike NoN with 
k = A:j nt |-a and a giant component that is smaller by a fac¬ 
tor of in. Nonetheless the value of p, will be the same 
as for a regular treelike NoN with k = k mhd . We show 
analytic solutions of these equations along with simula¬ 
tions in Fig. [2] for varying m and varying n. By varying 
either of these parameters we may have either one or two 
abrupt percolation transitions. Note that for the case of 
varying n the point of the first abrupt drop is the same for 
all curves. This is because the point where the modules 
separate depends only on m, a and k tot , but not on n (see 
Fig. 0- It is worth noting though that for larger n, the 
second regime, where modules exist independently (see 
Fig. [3b| , may not be present if the individual modules do 
not have enough intralinks to survive the damage from 
the dependencies. 

We demonstrate that in the case where there are two 
abrupt transitions, the first transition (at higher p ) rep¬ 
resents the separation of the modules and we therefore 
have m individual modules functioning separately. This 
is indicated by the spike in the size of the second largest 


r 


ules, there are m equal components functioning indepen¬ 
dently. After the separation into modules, we observe a 
second abrupt transition due to the interdependence. 

As m increases, the network begins to act more like 
a regular network of n interdependent Erdos-Renyi net¬ 
works. It is clear from the framework developed un¬ 
til now that there exists a critical value of m, m* above 
which the system undergoes a single transition whereas 
below in* the system first separates into separate modules 
before collapsing entirely. 

We will now determine p c and m* for this system us¬ 
ing the framework developed in Chap. II. For certain 
regimes there exist two first-order, discontinuous jumps 
in the size of the giant component (see Fig. [2a]). We 
define p c as the point where the first (higher p) jump oc¬ 
curs, regardless of whether there is a second jump after¬ 
wards. If desired, the point of the second jump can be 
found by solving for the critical threshold for a typical 
Erdos-Renyi NoN with k = We will now solve for 
p c by first finding r c using Eq. ( |21 1 and then converting 
it to p c using Eq. 0 We recall that for the case of trees 
we use pd e p = (1 - e~ (k "" ri+ki " K ’ >p ° J ) n ~ ] in Eq. (21 1 as was 


component, 2 , in Fig. 2c and is demonstrated visually 
in Fig. [3] In general for a network composed of m mod¬ 


done in Eq. (23 1 . This gives us the following system of 
equations 


4 










FIG. 2: (a) and (b) Results of simulations and theory according to Eq. |23f for modular networks with a = 100 and A; tot = 4. In (a) 
we vary m with n = 2 and in (b) we vary n with m = 2. Note that by varying either of these parameters we may have either one or 
two first order transitions (at two different values of p). Note that for the limiting case, m = I and n = 2, i.e. the squares in (a) we 
obtain the known result of Buldyrev et al. (3) p c = 2A45/k lol = 0.611 for k to , = 4. For larger m , p c increases, implying that 
modular networks are more vulnerable under attack. In (c) we show the size of the second largest giant component, 2 , for the 
same parameters as in (a). This plot verifies that the first abrupt drop in is the result of modules separating and there is a 
regime where the largest and second largest components are essentially equivalent. Note as the number of modules increases the 
size of the second largest component decreases, yet there are more surviving components, i.e. for m = 10 there are 10 modules of 
similar size. In (d) we show p c , defined as the point of the first abrupt drop (at the largest p), as a function of m for several values 
of a with k tol = 4. Note that below m * p c drops quickly according to Eq. yet as m increases it decreases slowly according to 
Eq. 1 26 1 . The sharp kink where p c changes behaviors is m" and for m > m * there is only one single transition rather than two. 


Pdep = (1 - e 1 

p — ^ nter ^J y kin\i a P 00 ^ _j_ y. ^ 1 g— (Sintra+^inter)^ > 00 (^intra+^inter)^ 5 oo^W—1 

-b + V b 2 - 4 ac 


2 a 


(24) 

(25) 

(26) 
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(a) (b) 

FIG. 3: a. Demonstration of the network in the initial state before the attack. The red links are connectivity links and the torquoise 
links are dependency links. We highlight the interconnected nodes which will be removed by the attack (note that we only perform 
the attack on one of the networks), b. Demonstration of the network after the removal of the interconnected nodes. As shown, the 
attack divides both networks into their separate modules and we have two components each of which behaves like a typical 

interdependent network of Erdos-Renyi networks. 


with the values of a, b and c being the coefficients from 

Eq. <£T}. 


We see in Fig. 2d that the simulations fit the theory 
well except near the point where we switch to having a 
single abrupt transition. This small discrepancy is be¬ 
cause there are large fluctuations in the fraction of in¬ 
dividual modules that are part of the giant component, 
which are not considered in the mean-field approach. 
Once we move away from this critical point the theory 
again fits the simulations. 


In order to find m* we compare the value of p when r = 
0 to the p c for a treelike network of networks with k = 
k mlm . Essentially this means comparing the fraction of 
nodes needed to remove all interconnected nodes and the 
value of p c where the modules themselves break apart. 


We can trivially find the value of p when r - 0 by 
noting that r = P x _ e e -k°^', ■ We obtain in terms of m 


We note that the value of p c for a treelike network of net¬ 
works (without communities) was determined by Gao et 
ai. m. In order to find p, we first find the value of k mm , 
the degree at which the system undergoes a transition. 
This is done using the system of equations 

fc = - [nW (--e - lln ]- 1 (28) 

n 

k mln = [nfcO -f c y n -' ] ]- ] (29) 

where W(x) is the Lambert function. 


Then p c = k m i„/ < k > where < k > is the average 
degree of each network, in our case < k >= k mtra . We 
obtain 


Pc = 


k m in((X+m- 1 ) 
ktotCt 


(30) 


p(r = 0) = e km 


m— 1 
a+m—l 


(27) The value of m* is found by setting Eq. ([27| equal to 
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Eq. (30 1 to obtain 


IV. LOOP OF INTERDEPENDENT MODULAR 
NETWORKS 


j * , m*— 1 

k min (a+m —1) —k tot * i 

mmy l - — e 101 a+m*-\ 

k tot a 


(31) 


This equation can be solved numerically for any value of 
n and a. Essentially, there are two competing effects in 
this equation. The left side represents the value of p c for 
an interdependent network of networks with k = kj ntra 
and the right side represents the point where we have 
removed all nodes with an interlink. As m increases, 
kjntra decreases, meaning that the modules become more 
vulnerable and p, from the left side of the equation in¬ 
creases. On the other hand, as m increases, k mlcr increases 
so more nodes have an interlink and p c on the right side 
of the equation decreases (more resilient). We demon¬ 
strate these two effects and show the point where they 


intersect in Fig. 4a Further we show the value of m* for 


various values of a and n in Fig. 4b Also, as n increases, 
k m i n increases, meaning the affect of the interdependence 
is stronger. Essentially it causes the dashed curve in Fig. 
4a to increase, thus decreasing m*, the point where the 
curves intersect. Thus for larger n we have a lower m*, 
as seen in Fig. [4b] 


We will now demonstrate our approach on another ex¬ 
ample where we consider the specific case of a directed 
loop of modular networks. In this case, for simplicity, 
we perform the initial attack on all of the networks rather 
than just one of them. Also, whereas the dependency 
links in Chap III. were bidirectional here we use unidi¬ 
rectional links as part of a loop (see Fig. [Tb| . The frac¬ 
tion of nodes which are interdependent is defined as q, 
i.e. 1 - q is the fraction of autonomous nodes, and is as¬ 
sumed here, for simplicity, to be the same for all pairs of 
networks. Here again, we will only consider dependency 
links which are restricted to being between two networks 
but within the same module. It has been shown that for 
looplike NoNs the number of networks in the loop is not 
relevant to the calculation 101 f37] [52l l. 

The equation governing this system is once again Eq. 
dT2]) with /7dep = (1 — q + qPoo)- Substituing this into Eq. 

(12 1 gives 


j(e k """(] - r)(l - e *' n,ra/ ’“) + r(\ - e tt,n, ' a+ * l "t er)/J “)^ (1 - q + qP ro ) 0 < r < 1 

|J(1 - e - k '^ m! '-)(\ - q + qmPco) r < 0. 


(32) 


We compare simulations and theory according to Eq. 
< |32| ' in Fig. |5| We note that here if the system under¬ 
goes two transitions, the first one (at a higher p) is abrupt 
and the second one is either continuous or abrupt. For 
the parameters we used, looplike networks of networks 
undergo a second order transition fflOl l52l . yet for dif¬ 
ferent values of k tot and q they can undergo an abrupt 
transition. For looplike NoNs, the number of networks, 
n, does not play a role but increasing q the fraction of 
interdependent nodes, weakens the resilience of the sys¬ 
tem (see Fig. [5b] >. We further note that for looplike NoNs 
there is a maximum coupling, q mix above which the en¬ 
tire network collapses even for p —> 1. Our value for 


r 


<7max will be the same as that of Gao et al. [5_2|, namely 
q max = 1 - 1 /k tot since for p - 1 our networks respond 
to random percolation like ER networks. Indeed, in Fig. 
5b we do not show higher values of q since the system 
does not survive even for p — 1 if q > 1 - l/k tot . For ex¬ 
ample, with k tot = 4 (the value in our plots) we obtain a 
maximum coupling of q = 0.75, above which the system 
collapses even for p —» 1. 


Following the analysis in Chap. II we can find p c using 
Eq. pT]). In this case pd ep = (1 - q + qPoo)~ which we 
will substitute into Eq. (21 1 . Our system corresponding 
to Eq. d26| becomes, 


Pdep — (1 (/ qPco ) 

Poo = (e~ kin,a {l - r)( 1 - e~ k *“ aP °°) + r( 1 - e < k ^‘ +k ^ 

—b + yJb 2 - 4 ac 


2 a 


(33) 

(34) 

(35) 


7 




















FIG. 4: a. We show how to obtain m* by plotting Eq. 1 27 1 and Eq. (|30j> for the case of n = 2, k = 4, and a = 100. The curve 
showing Eq. decreases with m since the number of interlinks increases with m so a larger fraction of nodes have an 
intermodule connection. On the other hand, p c in Eq. ( |30| > increases since for fixed k, as m increases fc,„, ra decreases so the 
modules themselves are more vulnerable. The value of m* is determined by the intersection of the two curves, b. The value of m* 
vs. a according to Eq. 0 for several values of n with k = 4 is shown. 


with the values of a , b and c being the coefficients from 
Eq. ©. We plot the p c obtained based on the theory 


and compare with simulations in Fig. 5c 


To find m* we use the same method as was done in 
Chap. Ill for treelike networks of networks. Specifically 
we compare the p c at which the modules become sepa¬ 
rated and the p, for a network of networks with k = k mm . 
We have from Gao et al. l52l that p, for a looplike NoN 
is p c = k( \_ q) ■ If we solve this and use the representation 
with a and m rather than k; ntra , we obtain 


1 


k tol a( 1 - q) 


(36) 


The values of m*, as a function of a, based on Eq. 


can be seen in Fig. 5d Increasing q decreases the ro¬ 
bustness of the individual modules and thus decreases 
the value of m* since the system is more likely to col¬ 
lapse before the modules are separated. 


transition occurs when the individual modules collapse. 
For the case of a fully interdependent treelike NoN with 
bidirectional dependency links, both of these transitions 
are first order, whereas for a looplike NoN with unidi¬ 
rectional dependency links the first transition (higher p) 
is abrupt while the second is either abrupt or continu¬ 
ous depending on the parameters. These results might be 
relevant for many interdependent systems such as finan¬ 
cial networks, biological networks and are particularly 
relevant for models of city infrastructure where most of 
the interdependence presumably occurs within a single 
city (regarded here as a community) even though there 
are connections to other cities. Another reason our at¬ 
tack is realistic for city infrastructure is because the in¬ 
terconnected nodes contain the interconnected links that 
are longer and therefore more likely to fail ED. 

We also note that the theoretical approach developed 
here can be used for many other types of targeted attack 
and for other network of network structures as well. 


V. DISCUSSION 

In summary, we have developed a framework for 
studying attacks on interdependent modular networks. 
Our results show that modular NoNs can behave signifi¬ 
cantly differently from random NoNs or spatially embed¬ 
ded NoNs in that they may undergo two separate percola¬ 
tion phase transitions. One transition occurs (at a higher 
p) where the modules become separated, and a second 
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FIG. 5: We show simulations and theory according to Eq. 1 32 ' with k = 4, a = 100 and a. q = 0.5 and varying m; and b. m = 2 
and varying q. In (c) we show p c as a function of m with q = 0.5 and several values of a. Until the sharp kink the theory is 
governed by Eq. ( |27| ) whereas after the kink p c changes according to Eq. p5[ >. In (d) we show the value of m* vs. a for several 

values of q with k = 4. 
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